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There is increasing interest in low-cost, scalable approaches that support parent engagement in their children’s learning at 
home. This study examined the impact of one such approach on pre-kindergarteners’ literacy development during an aca- 
demic year in a suburban public school setting that prioritized enrollment for children living in poverty. Parents were ran- 
domly assigned within children’s classrooms to receive either: (a) a language and literacy text messaging program or (b) a 
health and well-being text messaging program. Unexpectedly, findings indicated that children entering the school year with 
higher skill levels benefited from the language/literacy program while those with lower initial skill levels benefited from the 
health/well-being program. Although this approach shows promise in impacting some children’ literacy skills, it is clear that 
“one size” does not fit all families and that some families may benefit from text messages on basic needs such as sleep, nutri- 


tion, health, and behavior. 
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PARENT engagement in young children’s learning is critical 
to children’s development of a host of foundational abilities 
that impact later school success (Paratore, Cassano, & 
Schickedanz, 2011; Whitehurst & Lonigan, 1998). Yet 
parental involvement in learning varies greatly across many 
factors, including socioeconomic status (SES; Henrich & 
Gadaire, 2008). A striking literacy gap is present between 
less and more economically advantaged children at pre-kin- 
dergarten entry and tends to persist into the school-age years 
(Chatterji, 2006). This gap can be explained in part by differ- 
ences in parenting practices (Waldfogel & Washbrook, 
2011). Therefore, one approach to improving children’s lit- 
eracy skills is to improve parent engagement in learning at 
home. Efficacious parent programs are often expensive 
(Cates et al., 2018). Researchers recently have begun to 
investigate technologies as low-cost, scalable solutions for 
shifting parent engagement (e.g., York, Loeb, & Doss, 2018). 
The present study examines the impact of a 25-week text 
messaging program designed to engage parents of at-risk 


pre-kindergarteners in home activities that support early lit- 
eracy and language development. 


Parent Engagement in 
Children’s Literacy Learning 


Children’s early literacy skills encompass their under- 
standings about how books and print are organized, knowl- 
edge of letter names and sounds, early writing attempts, and 
sensitivity to the sound structure of spoken language (i.e., 
phonological awareness; Rhyner, Haebig, & West, 2009; 
Whitehurst & Lonigan, 1998). Strong oral language skills are 
highly correlated with early literacy skills and are predictive 
of reading achievement (National Early Literacy Panel 
[NELP], 2008); consequently, language is a key domain to 
promote alongside early literacy skills. An extensive body of 
research demonstrates that early home literacy activities pre- 
dict children’s later reading and academic skills within pre- 
school and through the elementary grades (e.g., Burgess, 
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Hecht, & Lonigan, 2002; M. A. Evans, Shaw, & Bell, 2000; 
Inoue, Georgiou, Parrila, & Kirby, 2018; Sénéchal & 
LeFevre, 2014; Tamis-LeMonda, Luo, McFadden, Bandel, & 
Vallotton, 2017). 

In this study, we focus on parent engagement in learning 
at home, a component of broader parent involvement frame- 
works (Epstein, 1995; Epstein et al., 2019) that refers to 
parent-child interactions that reinforce formal learning at 
school as well as parents’ efforts to create a home environ- 
ment conducive to learning. Informal learning opportunities 
occur in the home as well as during shopping, recreation, 
and transportation or when visiting restaurants, libraries, or 
museums. Experts argue that to successfully prepare chil- 
dren for modern careers, we must take advantage of informal 
learning contexts rather than focusing exclusively on formal 
learning within the rather limited hours of the school day 
(Golinkoff & Hirsh-Pasek, 2016). Various national programs 
and policies seek to support informal learning such as the 
federally funded Head Start program, which emphasizes the 
importance of parental involvement broadly as well as par- 
ent engagement in learning at home more specifically 
(National Center for Families Learning, 2014; Zuckerman & 
Khandekar, 2010). A national evaluation of Head Start found 
that centers that facilitated parent involvement increased the 
frequency of home learning activities and enhanced aca- 
demic and behavioral outcomes for children (Ansari & 
Gershoff, 2016). 


Intensity and Costs of Parent 
Engagement Interventions 


Evidence shows that parents can support early literacy 
development by engaging their children in activities such as 
storybook reading, talking about letters and print, helping 
their child write, reciting songs or rhymes, and eliciting mul- 
tiple-turn conversations during everyday activities (e.g., 
Beals, De Temple, & Dickinson, 1994; Hindman, Skibbe, & 
Foster, 2014; Jordan, Snow, & Porche, 2000; Puranik, 
Phillips, Lonigan & Gibson, 2018). Moreover, meta-analytic 
reviews provide causal evidence that parenting interventions 
can positively impact young children’s early literacy skills 
(Jeynes, 2012; Manz, Hughes, Barnabas, Bracaliello, & 
Ginsburg-Block, 2010; Mol, Bus, De Jong, & Smeets, 2008; 
NELP, 2008; Reese, Sparks, & Leyva, 2010). Yet these inter- 
ventions vary greatly in their intensity and costs. Several pro- 
grams improve home literacy and language development 
with home visits from coaches (e.g., Brown & Lee, 2017; 
Hammer & Sawyer, 2016; Landry et al., 2017) or approaches 
that coach parents within pediatric waiting rooms (Cates 
et al., 2018). A common and effective approach to supporting 
home literacy is through group trainings, often offered within 
schools, in which parents learn how to effectively read books 
with their children (e.g., Anthony, Williams, Zhang, Landry, 
& Dunkelberger, 2014; Hackworth et al., 2017; Jeynes, 2012; 


Mol et al., 2008). It warrants noting that a group training 
approach may be problematic in that it places a significant 
burden of preparation on facilitators, is often poorly attended, 
and often requires multiple sessions (Anthony et al., 2014). 
Other efforts use recording devices that analyze the frequency 
of parent-child conversations as a method to help parents 
reflect on ways to have more frequent and rich conversations 
with their children (Gilkerson, Richards, & Topping, 2017; 
Suskind et al., 2016). The costs of these face-to-face pro- 
grams vary from $100 for group trainings to over $3,000 per 
parent-child dyad; home visiting approaches cost signifi- 
cantly more than methods that capitalize on after-school 
workshops or waiting room visits (Cates et al., 2018; Knight 
et al., 2016). In recent years, researchers and educators have 
begun to explore low-cost, technology-based approaches to 
support parents’ early literacy interactions with their children 
such as online tools and mobile apps (e.g., Vroom; Galinsky, 
Bezos, McClelland, Carlson, & Zelazo, 2017). In the present 
study, we examined the extent to which a low-cost parent text 
messaging program, delivering messages three times per 
week over the course of 25 weeks, impacted pre-kindergar- 
teners’ literacy development. 


Parent Text Messaging Programs 


Text messaging is a seemingly ubiquitous mode of com- 
munication worldwide, with approximately 13,000,000 texts 
sent every minute (Domo, 2018). The use of text messaging 
for communication transcends age and socioeconomic sta- 
tus; in fact, text messaging is the most widely used smart- 
phone feature (Neilson, 2013; Pew Research Center, 2015). 
Brief text messages could empower parents with informa- 
tion to incrementally change behaviors. Text messages may 
serve to focus parents’ attention on informal learning oppor- 
tunities and nudge them toward more frequently engaging 
their children in desirable activities (Castleman, 2015). A 
number of randomized control trials provide evidence of the 
benefits of text messaging interventions for positive adult 
behaviors such as: weight reduction (Patrick et al., 2009), 
smoking cessation (Rodgers et al., 2005), reduced alcohol 
consumption (Muench et al., 2017), increased savings 
(Karlan, McConnell, Mullainathan, & Zinman, 2016), 
improvements in physical activity (Fournier, d’Arripe- 
Longueville, & Radel, 2017), increased college attendance 
(Castleman & Page, 2015), and higher rates of child vacci- 
nation (Stockwell et al., 2012). Of highest relevance to the 
present study is a small but growing literature on using text 
messages to engage parents in their children’s literacy learn- 
ing (e.g., Doss, Fahle, York, & Loeb, 2018; Kraft & Monti- 
Nussbaum, 2018; Kraft & Rogers, 2015; York et al., 2018). 
Although it is doubtful that a text messaging program can be 
a panacea for closing the achievement gap, there is some 
promising evidence indicating that this approach warrants 
further investigation. 


Several studies of parent text messaging programs show 
impacts on children’s academic outcomes. A four-week 
experimental study found that when teachers communicated 
to high schoolers’ parents through individualized weekly 
one-sentence messages (via text, email, or phone, depending 
on preference) about students’ strengths and weaknesses, 
significantly more students earned summer course credit 
(Kraft & Rogers, 2015). Exploratory analyses indicated that 
impacts were due to the actionable nature of the messages 
(i.e., highlighting what students need to improve) as well as 
the influence of the text messages on the content of parent- 
child conversations. Another study found a text messaging 
program that promoted summer reading for elementary stu- 
dents improved reading comprehension for third- and fourth- 
grade children but not first and second graders (Kraft & 
Monti-Nussbaum, 2018). These text messages also provided 
parents with actionable tips to engage students in reading 
over the summer months, such as taking turns reading aloud. 
A third study examined a parent text messaging program that 
provided parents of kindergarten children with activities that 
were both personalized (i.e., explaining their child’s under- 
standing of particular literacy skills) and differentiated (1.e., 
providing activities tailored to each child’s literacy level; 
Doss et al., 2018). This program resulted in higher child 
reading levels, but impacts were more pronounced for stu- 
dents entering the year with relatively low or relatively high 
skills. Interestingly, this study included a treated comparison 
group who received generic literacy texts, but these text 
messages did not appear to impact children’s literacy skills. 

Although emerging research suggests promise for parent 
text messaging with elementary-age students (Doss et al., 
2018), the present study focuses on slightly younger pre- 
kindergarten children because the pre-kindergarten year may 
represent a pivotal juncture for engaging parents in their 
child’s learning. Pre-kindergarten marks a major transition 
for most families as they prepare for their child’s move to 
elementary school, which typically requires identifying a 
new school program and preparation to ensure the child is 
“ready” for school. During this transition to formal school- 
ing, families may be more open to new influences in ways 
that affect the child’s school trajectory (Rimm-Kauffman & 
Pianta, 2000). While text messaging has been used as part of 
broader interventions with parents of preschoolers (e.g., 
used as reminders; Mayer, Kalil, Oreopoulos, & Gallegos, 
2015), we identified only one study that specifically exam- 
ined the impact of text messages designed to improve par- 
ent-child interactions on preschoolers’ academic outcomes. 

York and colleagues (2018) implemented an 8-month text 
messaging intervention called Ready4K! in the San Francisco 
Unified School District in two cohorts during the 2013-2014 
and 2015-2016 school years. Over 900 parents of 4-year-olds 
were randomly assigned within each of 34 sites to receive the 
intervention. These parents received three text messages per 
week: (a) a fact message to provide information and motivate 
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parents, (b) a tip message that provided specific activities 
that could be completed within the context of existing family 
routines (e.g., bath time), and (c) a growth message that pro- 
vided parents encouragement and a follow-up activity. Text 
topics were structured as a spiral curriculum, starting simply 
but becoming more complex over time, with some skills 
revisited throughout the year. During the first cohort of the 
program, parents assigned to the treatment condition 
received language and literacy text messages that focused on 
skills such as alphabet knowledge, phonological awareness, 
vocabulary, parent-child conversations, and book-reading 
routines. These participants also received messages that pro- 
moted parent involvement at school (e.g., Ask your teacher 
about . . .) and explicitly linked to the district’s Raising a 
Reader program, which sent home books to children on a 
regular basis. In the second cohort of the program, parents 
assigned to the treatment condition received math (e.g., 
counting, shapes, patterns, number recognition) and social- 
emotional text messages (e.g., identifying emotions, emo- 
tion regulation, sharing, turn-taking) in addition to the 
language and literacy texts. The control group in both 
cohorts received a text message every two weeks about the 
school district’s vaccination requirements or kindergarten 
enrollment process. Curiously, findings indicated that the 
intervention had a significant main effect on children’s lit- 
eracy outcomes only in the second cohort, when fewer liter- 
acy-related text messages were sent. Further analyses 
indicated that the effects across both cohorts seemed to 
depend on children’s level of skill at baseline; that is, chil- 
dren entering pre-k with a lower skill level appeared to ben- 
efit from the program. While York et al.’s (2018) study 
demonstrated evidence of promise for increasing young 
children’s literacy skills, further research is needed to under- 
stand whether language/literacy text message topics alone 
are sufficient to improve children’s literacy skills. 


Purpose of This Study 


The purpose of the present text messaging study was to 
extend the work by York et al. (2018) in a different context 
(i.e., suburban vs. urban), with a higher quantity of action- 
able text messages, and with a more robust treated compari- 
son group that received an equal number of text messages. 
Specifically, all of our literacy text messages were action- 
able (rather than informational only) in that they provided 
parents with an activity and sample script. In addition, we 
developed an equal number of text messages for the com- 
parison group to ensure effects were not due to differences in 
intensity alone. In an effort to make all text messages useful 
to parents, the comparison group was provided with infor- 
mation about non-literacy related topics (e.g., sleep habits, 
nutrition, safety, behavior). In an era where parents may be 
increasingly exposed to educational text messages from 
many public sources, it is important to contrast a literacy text 
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messaging program with another educational text messaging 
program as the latter may more realistically represent “busi- 
ness as usual” practices. 

Our research questions were two-fold: 


Research Question 1: What are the effects of a language 
and literacy text messaging program contrasted with a 
health/well-being text messaging program on literacy 
outcomes of pre-k children enrolled in a suburban 
public school setting targeting enrollment for children 
living in poverty? 

Research Question 2: Did these effects depend on chil- 
dren’s level of initial literacy skill? 


We hypothesized that there would be a significant positive 
effect of the literacy text messaging program on children’s 
literacy skills. Despite York et al.’s (2018) prior findings that 
children with lower initial skills seemed to benefit most 
from the program, we did not have a directional hypothesis 
about the second research question due to the larger pre- 
school intervention literature that reports inconsistent evi- 
dence of differential effects (e.g., Cabell et al., 2011; 
Hindman, Connor, Jewkes, & Morrison, 2008). 


Method 
Research Design and Participants 


This randomized controlled trial examined the impact of 
a text messaging parent program on children’s literacy skill 
development. Data were collected in a single suburban 
school district in a mid-Atlantic state that prioritized public 
school pre-k enrollment for children deemed at risk for later 
academic difficulty who were not served by Head Start (i.e., 
family income at or below 200% of federal poverty guide- 
lines, homelessness, parents were school dropouts, family 
income less than 350% of poverty for students with disabili- 
ties). Within each classroom, half of the parents were ran- 
domly assigned to receive language and literacy text 
messages (treatment), whereas the other half received text 
messages on alternate topics addressing children’s health 
and well-being, including safety, exercise, behavior, and 
nutrition (comparison). By conducting random assignment 
within each classroom, we controlled for classroom influ- 
ences such as classroom instructional quality. This study was 
not preregistered. 

Participants included 177 parents (mostly mothers) and 
their 4-year-old children (MM = 53.95 months, SD = 3.74) in 
13 pre-k classrooms across seven schools (range = 7-18 par- 
ticipating students per classroom). In six instances, children 
had two separate households (i.e., mother and father) who 
asked that both receive text messages, so 174 different fami- 
lies were represented in the sample. In addition, there was 
one instance where a parent had two children in a single 
classroom, so we randomly selected one child for analysis. 


Demographic or test data were not provided from the district 
for one child, so our final analysis sample was 174 children, 
with parents of 87 randomly assigned to each condition. Over 
half of the children were female (53.4%), and most were 
Caucasian (66.7%) or African American (21.3%), with 5.2% 
Hispanic. We did not find any evidence that the treatment or 
comparison groups differed on either child demographics or 
baseline literacy skills. Table | presents the baseline study 
variables by condition and for the full sample. 


General Procedure 


Parents were provided the opportunity to participate by 
classroom teachers who were informed of the program 
through a district meeting with the first author. Text mes- 
sages were delivered for a period of 25 weeks (November 
2015—April 2016) by the research team via the Signal Vine 
platform, and teachers did not have access to the messages 
nor were they aware of which parents were randomly 
assigned to treatment and comparison conditions. Teachers 
individually administered a battery of literacy assessments 
to students as per their usual practices prior to and after the 
intervention period during 2-week windows established by 
the school district. 


Intervention Design 


Treatment condition. The treatment condition consisted of 
text messages that focused on providing suggestions for par- 
ent-child interactions to enhance children’s language and 
literacy development. The program was 25 weeks in length, 
with 23 weeks focused on specific content. Each week fea- 
tured three text messages—delivered Monday, Wednesday, 
and Friday—on a specific topic (e.g., expanding on child 
talk, encouraging name writing) that was embedded within 
broader categories for language and literacy domains. These 
categories were explicitly listed at the beginning of each text 
message. Language categories included: Discuss Books, 
Talk & Listen, Tell Stories, and Ask Questions. Literacy cat- 
egories included: Teach Letters, Listen for Sounds, Rhyme, 
Word Play, and Write. Language and literacy categories 
rotated, and topics were generally sequenced to increase in 
complexity over time. For example, phonological awareness 
activities increased in difficulty over time; parents were first 
encouraged to have children generally listen for sounds 
(week 5), then play rhyming games (weeks 7 and 13), and 
later move to blending syllables (week 15) and identifying 
beginning sounds in words (week 19). 

The text messaging program also included other features 
in addition to the tips to enhance children’s language and 
literacy development. First, text messages were personalized 
to include the child’s name and gender (e.g., “Ask Joseph to 
close his eyes. Knock on a table. Say, “Can you guess what 
makes that sound?’ Try different sounds.”). Second, each 
text message was purposefully actionable, most containing 


TABLE | 
Descriptive Statistics by Condition for Baseline Study Variables 


Mean (SD) or Count (%) 
Comparison Treatment Overall Test for 
Variable (n = 87) (n = 87) (N = 174) Treatment Effect 
Child characteristics 

Gender, n (%) (1) =.21 
Male 39 (44.8) 42 (48.3) 81 (46.6) p= .65 
Female 48 (55.2) 45 (51.7) 93 (53.4) 

Race, n (%) 473) =.72 
White 59 (67.8) 57 (65.5) 116 (66.7) p=.87 
Black 17 (19.5) 20 (23.0) 37 (21.3) 

Hispanic 4 (4.6) 5 (5.7) 9 (5.2) 
Other 7 (8.0) 5 (5.7) 12 (6.9) 
Age in months, M (SD) 53.94 (4.00) 53.97 (3.49) 53.95 (3.74) t(152) =—.06 
p=.95 
Fall scores on Phonological Awareness 
Literacy Screening tasks (maximum), M (SD) 
Print and Word Awareness (10) 4.76 (2.89) 5.09 (3.12) 4.92 (3.00) t=-0.69 
p= 49 

Upper-Case Alphabet Recognition (26) 9.31 (8.35) 10.58 (9.21) 9.94 (8.78) t=—0.90 

p=37 

Lower-Case Alphabet Recognition (26)* 8.16 (8.21) 9.73 (8.53) 8.96 (8.37) t=—1.04 

p=.30 

Letter Sounds (26)° 3.64 (5.67) 3.13 (4.28) 3.38 (4.99) t=0.55 

p=.58 

Nursery Rhyme Awareness (10) 5.1 (2.47) 4.71 (2.86) 4.91 (2.67) t=0.91 

p=.36 

Rhyme Awareness (10) 4.26 (2.42) 4.2 (2.52) 4.23 (2.46) t=0.15 

p=.88 

Beginning Sound Awareness (10) 3.74 (3.69) 3.83 (3.78) 3.79 (3.72) t=—0.14 

p=.89 

Name Writing (7) 4.24 (1.85) 4.28 (2.19) 4.26 (2.02) t=-0.10 

p=.92 


“Students are administered Lower-Case Alphabet Recognition when they score at least 16 on the Upper-Case Alphabet Recognition task. 
’Students are administered Letter Sounds when they score at least 9 on the Lower-Case Alphabet Recognition task. 


an example of what a parent might say (e.g., “Touch each 
letter as we name them together.”). This decision was based 
on prior focus groups conducted by our research team during 
the development phase of the program as well as research 
reporting that specific text messages appeared to be more 
beneficial than general ones (York & Loeb, 2014). Third, the 
initial text message each week usually included information 
about the importance of the week’s topic (e.g., “Reading 
with Sarah Grace builds your relationship,” “Talking with 
Todd can make him smarter,” “Singing can help Kristin 
learn rhyming words.”). Fourth, parents were periodically 
provided with reinforcement regarding their important role 
in their children’s development (e.g., “You are your child’s 
most important teacher!”). This kind of feedback was 


generally provided when parents responded (either yes or 
no) to the fourth message of the week, asking them whether 
they had time to do a suggested activity during the week. See 
the online Supplemental Material for a full set of treatment 
group text messages. 


Comparison condition. Parents in the comparison condition 
received an equivalent number of health and well-being text 
messages throughout the 25-week period. These messages 
were delivered on the same schedule as the treatment condi- 
tion messages, three times per week (Monday, Wednesday, 
Friday), with a fourth message asking whether they had 
time to promote a healthy habit or whether the information 
was useful. Similar to the treatment condition, the week’s 
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messages stayed on a single topic (e.g., healthy drinks) 
within a broader category (e.g., nutrition). Categories 
included: Nutrition, Sleep Habits, Health, Wellness, Exer- 
cise, Behavior, Safety, Self-Confidence, Sharing, Transi- 
tions, Chores, and Bedwetting. These messages were also 
personalized to include child name and gender (e.g., “Set a 
good example by serving healthy foods that you like or eat- 
ing something new so Tamara sees you enjoying what you 
are asking her to eat.”). Feedback was provided to parents 
after they answered the fourth message and discussed the 
importance of the parent’s role in promoting healthy habits 
and well-being. See the online Supplemental Material for a 
full set of comparison group text messages. 


Intervention Fidelity Across Conditions 


Parents across conditions were sent a fourth text mes- 
sage per week (delivered on Friday) to which they were 
asked to respond. They were generally asked (a) whether 
they had the time to implement the activity (treatment 
group) or promote healthy habits (comparison group) or (b) 
whether the information was useful to them (comparison 
group only). In general, parents were responsive to the text 
messages across conditions. Seventy-six percent (76.4%) 
of parents responded at least once during the intervention, 
and 58.6% of parents responded at least five times, provid- 
ing some indication that text messages were received and 
implemented. Overall response rates per week ranged from 
35% to 58%. Responses were overwhelmingly positive, 
with very few parents providing a response of not helpful 
or no (range per week = 1%—4%). Between treatment and 
comparison conditions, there were no significant differ- 
ences on the number of parents responding to the text mes- 
sages or the level of reported engagement with the content 
of the text messages, with parents in the treatment and 
comparison conditions providing an average of 11.78 
(SD = 7.92) and 13.36 (SD = 7.95) yes responses, respec- 
tively, across the 23-week program, t(136) =—1.05, p = .30. 
Within the treatment condition, parents did not appear to 
favor language-focused or literacy-focused text messages, 
reporting about 7 yes responses for both types of texts. 
During the course of the study, 14 treatment and 13 com- 
parison parents requested that messages stopped being 
delivered, but they did not remove their children from the 
study, and thus, these outcomes remained in our intent-to- 
treat analyses. 


Measures 


Children’s literacy skills were measured using the English 
version of the Phonological Awareness Literacy Screening 
for Preschool (PALS-PreK; Invernizzi, Sullivan, Meier, & 
Swank, 2004). Specifically, teachers individually assessed 
children’s print knowledge, phonological awareness, and 


early writing skills. We are unable to publish the raw data 
from this study because we did not receive district permis- 
sion to archive the data. 


Print knowledge. Specific print knowledge skills were 
assessed, including print-concept knowledge and alpha- 
bet knowledge. To measure print-concept knowledge, 
teachers administered the Print and Word Awareness task, 
which involves teachers sharing a book with a child and 
asking him or her to identify particular components, 
including the title, individual letters and words, and the 
direction print moves on a page (maximum score = 10). 
The PALS-PreK technical manual reports an internal con- 
sistency of .75 (Cronbach’s alpha) for this task. To mea- 
sure alphabet knowledge, teachers first administered the 
Upper-Case Alphabet Recognition task. This task requires 
children to point to and say the name of the 26 upper-case 
letters of the alphabet displayed in random order on a 
single sheet of paper (maximum score = 26). Children 
who scored 16 or more on this task were administered the 
next task, Lower-Case Alphabet Recognition, which was 
similar to the upper-case task expect with lower-case 
forms (maximum score = 26). Children who scored 9 or 
more on the lower-case task were administered the next 
task, Letter Sounds, which measured knowledge of con- 
sonant sounds, short vowels, and a few digraphs (e.g., sh; 
maximum score = 26). The PALS-PreK technical manual 
reports an interrater reliability of .99 across upper- and 
lower-case tasks. 


Phonological awareness. Children’s awareness of the sound 
structure of spoken language was assessed by examining 
children’s understanding of rhyme and beginning sounds. 
The Nursery Rhyme Awareness task is a cloze activity in 
which children are asked to fill in the missing rhyming word 
in a line of a common nursery rhyme (e.g., Jack be nimble, 
Jack be quick. Jack jump over the candle .; Maximum 
score = 10; Cronbach’s alpha = .77). The Rhyme Awareness 
task measures children’s ability to match a target picture to a 
picture of a rhyming word from a series of three pictures 
(maximum score = 10; Cronbach’s alpha = .84). The Begin- 
ning Sound Awareness task requires children to produce the 
letter sound (or letter name) at the beginning of a spoken 
word illustrated on a picture card, with possible beginning 
sounds of /m/, /s/, and /b/. This task takes place in the context 
of a teacher-led picture sort, with three practice items serving 
as header cards (man, sock, bag) and cards being placed under 
appropriate headers. While teachers provide corrective feed- 
back during this task, they score children’s first oral response 
(maximum = 10; Cronbach’s alpha = .93). To avoid confu- 
sion, teachers are asked not to administer these latter two 
phonological awareness measures consecutively. The PALS- 
PreK technical manual reports an interrater reliability of .99 
for all phonological awareness tasks. 


TABLE 2 


Main Effects of the Language and Literacy Text Messaging Program on Spring PALS Task Scores 


PALS Task 6 for Intervention Condition SE (B) 77) Partial d 
Print and Word Awareness —.062 .054 25 —0.15 
Upper-Case Alphabet Recognition —.104 .065 atl —0.23 
Lower-Case Alphabet Recognition —.120 080 13 —0.29 
Letter Sounds —.038 .056 50 —0.08 
Nursery Rhyme Awareness —.100 O51 05 —0.28 
Rhyme Awareness =117 .068 .08 —0.26 
Beginning Sound Awareness —.069 .059 24 —0.16 
Name Writing —.141 054 .009 —0.44 


Partial d is calculated as the difference between the estimated marginal means for the intervention and control groups divided by the standard deviation of 
those in the control group. PALS = Phonological Awareness Literacy Screening. 


Early writing. Children’s early writing skills were measured 
with the PALS-PreK Name Writing task. A child is asked to 
draw a self-portrait and label it with his or her name. Scoring 
of the written name representation is based on a develop- 
mental continuum of orthographic knowledge that includes 
writing with scribbles, letter-like forms, some letters, and 
finally all letters in one’s name (maximum score = 7; interrater 
reliability = .99). 


Results 
Missing Values Analysis 


There were no missing values on any of the child demo- 
graphic variables. Of the 174 children in the sample, a total of 
147 children (84.5%) had complete data on all of the PALS 
tasks for both the fall and spring assessment windows. Twenty 
children (11.5%) had complete data in the fall but were miss- 
ing all data in the spring. Six children (3.4%) were missing all 
data in the fall but had complete data in the spring. One child 
(0.6%) had complete data in the fall and was only missing 
data on the Beginning Sound Awareness task in the spring. 
Tests of the bivariate relations of having complete data in the 
fall and having complete data in the spring with condition, 
child gender, child race, and child age were not significant (all 
ps > .16). Having missing data in the fall was not significantly 
related to PALS task scores in the spring (all ps > .25). Those 
missing data in the spring had significantly lower scores on all 
alphabet knowledge tasks in the fall than those with complete 
data in the spring: Upper-Case Alphabet Recognition, 49.15) 
=—2.91, p =.02; Lower-Case Alphabet Recognition, t(6.06) = 
—4,55, p = .004; and Letter Sounds, #(15.61) =—3.95, p =.001. 
Scores on other PALS tasks in the fall were not significantly 
related to having complete data in the spring (all ps > .05). 


Main Effects of the Text Messaging Program 


Our primary research aim was to examine the effect of 
a parent text messaging program on children’s literacy 


development. Since the intervention was applied at the child 
level, all of our models are correspondingly run at the child 
level. All predictive models were estimated using Mplus 
version 8. Coefficients were obtained using full information 
maximum likelihood estimation. This type of estimation 
accounts for missing data by using all available data for each 
case in estimating parameters to adjust for potential bias in 
the estimates resulting from missing data and has been iden- 
tified as one of the optimal ways to handle missing data in 
education research (Peugh & Enders, 2004). To accommo- 
date for the nesting of children within classrooms, we took 
advantage of Mplus’s ability to adjust the standard errors of 
our parameter estimates to account for within-classroom 
dependence using a sandwich estimator. 

Our first set of analyses explored the effects of the lan- 
guage and literacy text messaging program on gains in lit- 
eracy task means. This relation was tested by predicting 
each spring PALS task score from a dummy code represent- 
ing the treatment condition (with the comparison condition 
as the reference group), the standardized fall PALS task 
score, a dummy code for child gender, a collection of 
dummy codes for child race, and child age. Each PALS task 
was examined in a separate model. Table 2 presents the 
standardized coefficients for the main effect of the treat- 
ment condition in each of these models. The coefficients for 
the covariates were omitted from the table for the sake of 
parsimony but can be obtained from the authors. The vari- 
ance estimate used when calculating the effect sizes is based 
only on those in the comparison condition to ensure that it 
is not influenced by the treatment. This is a standard prac- 
tice when calculating effect sizes in intervention studies. 
The results indicate that there were main effects of the 
intervention on children’s early writing (i.e., Name Writing 
task) and phonological awareness (1.e., Nursery Rhyme 
Awareness task) such that those in the treatment condition 
showed less improvement than those in the comparison con- 
dition. However, after applying the Benjamini-Hochberg 
method to correct for multiple comparisons, a method less 
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stringent than the traditional Bonferroni method, neither 
effect maintained significance (Benjamini & Hochberg, 
1995). However, for four of the eight PALS tasks, the nega- 
tive effect size was substantively meaningful (i.e., equal to 
or greater than an absolute value of 0.25), in favor of the 
health and well-being text messaging program (i.e., lower- 
case alphabet knowledge task, rhyming tasks, and early 
writing task; What Works Clearinghouse, 2017). These are 
small- to medium-sized effects according to the guidelines 
of Cohen (1992). 


Treatment by Baseline Interactions 


Next, we tested the extent to which the effect of the inter- 
vention might vary with the child’s pretest score. This rela- 
tion was tested by predicting each spring PALS task score 
from a dummy code representing the treatment condition 
(with the comparison condition as the reference group), the 
standardized fall PALS task score, the product of the condi- 
tion dummy code and the standardized fall PALS task score, 
a dummy code for child gender, a collection of dummy 
codes for child race, and child age. Each PALS task was 
examined in a separate model. For the overall PALS fall 
score, 14.1% of the comparison group and 19.7% of the 
intervention group were less than 1 SD below the mean, 
whereas 16.7% of the comparison group and 21.1% of the 
intervention group were more than | SD above the mean. 
This suggests that our extreme groups were sufficiently 
large in both conditions to justify the use of the pretest 
scores as moderators. 

Table 3 presents the standardized coefficients for the 
main effect of the treatment condition in each of these 
models. The coefficients for the demographics were omit- 
ted from the table for the sake of parsimony but can be 
obtained from the authors. After applying the Benjamini- 
Hochberg correction, we observed significant interaction 
effects for Print and Word Awareness, Nursery Rhyme 
Awareness, and Rhyme Awareness tasks, which are all 
illustrated in Figure 1. In all cases, children with relatively 
higher fall scores tended to perform better in the treatment 
condition, whereas those with lower fall scores tended to 
perform better in the comparison condition. The vertical 
lines in the plots delineate the regions of significance 
(Preacher, Curran, & Bauer, 2006) such that group compari- 
sons at values of the fall score between the two lines are not 
significant and group comparisons at values less than the 
lower line or greater than the upper line are significant. 
Although the interaction for Letter Sounds was no longer 
significant after correcting for the Type I error rate (critical 
value of .025), we explored this interaction and found the 
same interaction pattern as the other three tasks. However, 
unlike the other three tasks, the comparison between the 
treatment and comparison groups was not significant at any 
specific value of the fall score. 


Discussion 


This study examined the effect of two contrasting parent 
text messaging programs on the early literacy skills of pre- 
kindergarten children. In the treatment condition, parents 
received texts that encouraged language and literacy interac- 
tions within the context of daily family routines. In the 
treated comparison condition, parents received texts that 
provided them with information on important developmen- 
tal topics focusing on children’s health and well-being. 
Unexpectedly, our pattern of results suggested that the com- 
parison condition had better literacy outcomes. This finding 
was qualified by a significant interaction such that children 
entering the school year with relatively higher skill levels 
appeared to benefit from the language and literacy text mes- 
saging program while children entering the school year with 
relatively lower skill level appeared to benefit from the 
health and well-being text messaging program. 

Our results indicated that the health and well-being text 
messaging program, when compared with the language and 
literacy text messaging program, resulted in greater gains in 
children’s literacy skills over the course of the pre-kinder- 
garten year. This pattern of results, with meaningful effect 
sizes across multiple measures (though nonsignificant), was 
unexpected not only because of past positive findings 
reported by York et al. (2018) for a similar language and 
literacy—focused text messaging program encouraging 
parent-child interactions but also because other targeted pre- 
kindergarten academic programs generally result in aca- 
demic improvement in contrast to programs addressing the 
social-emotional skills and well-being of children only 
(Morris, Millenky, Raver, & Jones, 2013). However, upon 
close consideration, we noted this finding is somewhat con- 
sistent with York and colleagues’ reported finding for the 
study’s first cohort. In this cohort, parents received language 
and literacy messages comparable to our set of messages, 
with results indicating an overall negative, though nonsig- 
nificant, effect in favor of the control condition, which 
received placebo text messages every few weeks about non- 
related topics (e.g., immunization schedule). For their 
study’s second cohort, York et al. reported some findings 
favoring the treatment group when text messages included 
literacy, mathematics, and social-emotional skills. However, 
these positive effects appeared on two literacy subtests of the 
PALS-PreK measure—the Letter Sounds and Lower-Case 
Alphabet Recognition tasks—that were administered to only 
high-performing participants because this measure includes 
a branching structure such that children who score below a 
benchmark on easier subtests are not administered these 
harder subtests. Thus, consideration of the findings reported 
by York et al. should take into account this cautionary note 
regarding potential sample bias due to the administration 
guidelines for these tasks of PALS-PreK. In situating our 
results into the extant literature, it is important to note that 


TABLE 3 


Intervention by Fall PALS Score Interaction Effects on Spring PALS Task Scores 


PALS Task Predictor B SE (B) Dp 
Print and Word Awareness Fall score 323 049 <.001 
Condition —.063 043 1S 
Condition x Fall Score .180 052 001 
Student age in fall 148 .060 O01 
Female gender 088 053 .10 
African American race/ethnicity —.073 .076 34 
Hispanic race/ethnicity —.103 .086 23 
Other race/ethnicity .097 047 .04 
Upper-Case Alphabet Recognition Fall score 294 .069 <.001 
Condition —.107 .063 09 
Condition x Fall Score 105 088 23 
Student age in fall S173 .076 02 
Female gender .066 .065 31 
African American race/ethnicity 043 050 39 
Hispanic race/ethnicity =150 151 321 
Other race/ethnicity 035 041 399 
Lower-Case Alphabet Recognition Fall score 273 .069 <.001 
Condition =.113 .073 312 
Condition = Fall Score .166 098 .09 
Student age in fall —.083 081 30 
Female gender .064 .063 31 
African American race/ethnicity .035 045 44 
Hispanic race/ethnicity —.202 .186 28 
Other race/ethnicity 053 053 31 
Letter Sounds Fall score 238 .086 .006 
Condition —.035 .049 48 
Condition x Fall Score .133 .068 05 
Student age in fall —.026 089 TT 
Female gender 072 056 .20 
African American race/ethnicity 029 045 02 
Hispanic race/ethnicity —.202 133 13 
Other race/ethnicity 058 055 29 
Nursery Rhyme Awareness Fall score 124 116 28 
Condition —.104 056 .06 
Condition x Fall Score 315 056 <.001 
Student age in fall .073 053 17 
Female gender 034 .090 71 
African American race/ethnicity —.006 057 91 
Hispanic race/ethnicity —.202 150 19 
Other race/ethnicity —.006 .077 93 
Rhyme Awareness Fall score 105 .032 001 
Condition —.114 .068 .09 
Condition x Fall Score 184 .063 .003 
Student age in fall 032 057 58 
Female gender 019 056 74 
African American race/ethnicity —.045 .079 7 
Hispanic race/ethnicity —.287 138 .04 
Other race/ethnicity —.069 .077 38 
(continued) 


TABLE 3 (CONTINUED) 


PALS Task Predictor B SE (B) 2) 

Beginning Sound Awareness Fall score 241 082 .003 
Condition —.070 055 .20 
Condition Fall Score .083 .088 35 
Student age in fall —.079 083 34 
Female gender .079 .090 38 
African American race/ethnicity —.069 052 19 
Hispanic race/ethnicity —.166 124 18 
Other race/ethnicity 031 043 A8 

Name Writing Fall score .238 .069 001 
Condition —.140 053 .008 
Condition = Fall Score 131 11 24 
Student age in fall —.104 052 05 
Female gender .008 110 94 
African American race/ethnicity 093 103 37 
Hispanic race/ethnicity .106 044 02 
Other race/ethnicity .076 .037 .04 


PALS = Phonological Awareness Literacy Screening. 


York et al.’s study had a control group receiving placebo text 
messages, while our study featured two contrasting text 
messaging programs. Findings may have differed had we 
also included a third, placebo condition. 

Although our findings suggest that children with higher 
initial skill levels appeared to benefit more from the lan- 
guage and literacy—focused program, future research should 
examine whether an optimal approach may combine aca- 
demic topics with more basic information on positive par- 
enting strategies to support children’s health and behavior. 
Indeed, York et al. (2018) demonstrated some evidence of 
promise in the more comprehensive text messaging pro- 
gram, and the authors hypothesized that rotating the domains 
of literacy, mathematics, and social-emotional skills may 
have enabled parents and children to stay engaged with the 
program over the 8-month program period (see also Hurwitz, 
Lauricella, Hanson, Raden, & Wartella, 2015). Another pos- 
sible explanation of both their findings and ours is that this 
type of low-cost, technology-based support for informal lit- 
eracy learning is only efficacious when parents are informed 
about and responding to the developmental needs of the 
whole child rather than isolating literacy skills. The com- 
parison text messages targeting children’s health and well- 
being may have been of higher relevance to some parents, 
particularly if their children struggled with attention or 
behavior due to lack of sleep and routines that parents might 
have changed when texted information about positive par- 
enting strategies on such topics. Ideally, any successful text 
messaging program should provide parents with information 
on evidence-based parenting strategies and thereby promote 
a qualitative shift in parenting practices. It is likely that 
parents would be more engaged and open to changing their 
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behaviors if they perceived the program to be relevant to 
their needs and those of their children, and our findings sug- 
gest that preschoolers’ health and well-being is a relevant, 
foundational topic where families benefit from more 
information. 

We must ask why the two types of text messaging pro- 
grams in the present study appear differentially beneficial 
for children depending on their level of literacy skill upon 
entry into pre-kindergarten. There are several possible rea- 
sons for this result. First, as noted previously, the health/ 
well-being text messaging program may have better matched 
the needs of children in lower end of the skill distribution. 
Second, children’s initial skill level could be serving as a 
proxy for socioeconomic status (e.g., maternal education) 
even within this relatively low-income group (Cabell, 
Justice, Logan, & Konold, 2013). Children living in poverty 
are more likely to suffer from a variety of risk factors, such 
as low-quality physical environments, inconsistent parenting, 
chronic stressors, poor nutrition, lack of sleep, and increased 
behavioral issues (Adams, Hillman, & Gaydos, 1994; 
Alaimo, Olson, & Frongillo, 2001; G. W. Evans, 2004; 
McLoyd, 1998). The health/well-being comparison text pro- 
gram may have effectively nudged parents to attend to ways 
to reduce stress, lack of sleep, or lack of exercise, which are 
known to impair executive functions (Diamond, 2013; 
Lowe, Safati, & Hall, 2017; Ludyga, Gerber, Brand, 
Holsboer-Trachsler, & Piihse, 2016). In turn, increased 
parental responsiveness to basic needs may have resulted in 
better academic performance (Landry et al., 2012). For 
example, text messages focused on healthy sleep habits may 
have resulted in better child ability to maintain attention 
or improved memory, which in turn enhanced literacy 


Spring Print & Word Awareness 


0 2 4 6 8 10 
Fall Print & Word Awareness 


Comparison — — —Treatment 


Spring Nursery Rhyme Awareness 


0 2 4 6 8 10 
Fall Nursery Rhyme Awareness 


<= Comparison — — —Treatment 


Spring Rhyme Awareness 


6 i, , 
0 2 4 6 8 10 
Fall Rhyme Awareness 
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FIGURE 1. Plots of significant condition by fall score interactions. (A) Print and Word Awareness. (B) Nursery Rhyme Awareness. 


(C) Rhyme Awareness. 
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outcomes (Brock, Rimm-Kaufman, Nathanson, & Grimm, 
2009; Moreau, Rouleau, & Morin, 2013). 

In a similar vein, the literacy text messaging program 
may have better matched the needs of children entering the 
school year in the upper end of the skill distribution. Our 
literacy text messages may have unintentionally been 
geared toward more skilled children, who may have experi- 
enced more success with the activities and thus elicited a 
pattern of increased literacy interactions with their parents. 
There is evidence that a more differentiated literacy pro- 
gram tailored to skill level may be needed for the messages 
to serve the intended purposes of incrementally modifying 
parent-child interactions rather than simply serving as a 
nudge or reminder (Doss et al., 2018). In addition, the chil- 
dren at the upper end of the distribution may have gleaned 
more from activities as prior studies of classroom-based lit- 
eracy interventions have often demonstrated that skill 
begets skill as children with relatively higher initial skills 
gain more from the treatment (Cabell et al., 2011; Ceci & 
Papierno, 2005; Justice et al., 2010; Penno, Wilkinson, & 
Moore, 2002). Further explanations for this finding are that 
it may have been challenging or even frustrating for parents 
of lower performing students to complete the suggested lit- 
eracy teaching activities, whereas children with higher ini- 
tial skills may have experienced greater success and 
pleasure when engaging in literacy teaching activities. 
Indeed, the parent involvement literature suggests that par- 
ents foster learning at home when they believe activities are 
developmentally appropriate and experience a personal 
sense of self-efficacy that they can help their child succeed 
in learning (Hoover-Dempsey & Sandler, 1997). Or, parents 
receiving literacy text messages may have become overly 
didactic and skill focused because of the emphasis on aca- 
demic skills, resulting in less positive affective interactions 
(Baker, Mackler, Sonnenschein, & Serpell, 2001; Sonnen- 
schein & Munsterman, 2002). 


Limitations and Future Directions 


There are several salient limitations of this study that 
warrant note, many of which are due to the low cost of the 
study. First, we were missing key measures that may have 
helped us better understand the impact of this intervention. 
Specifically, we did not measure children’s language skills 
because districts in the state in which our study took place 
do not typically collect language data on pre-kindergarten 
children. While this limitation is also present in other simi- 
lar studies (e.g., York et al., 2018), half of our text messages 
were supporting children’s language development, and thus 
the omission of a language measure is a notable one and one 
that should be included in future research. In addition, 
health, cognitive, and social-emotional outcomes could 
have been measured to understand the potential mediating 
role of these skills in the relationship between informal 
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learning and literacy achievement. We also did not obtain 
pre- and postintervention data regarding home literacy 
activities. The inclusion of some of these measures in future 
studies may help elucidate the reasons for the differential 
effects of the programs. Second, we did not try to facilitate 
parent involvement at school or link to resources and pro- 
grams offered by the school (see York et al., 2018). 
Relatedly, our text messages were sent from an outside 
source (i.e., a text messaging service) rather than being per- 
ceived as coming from teachers, a trusted source. Teacher 
communication with parents to engage children in learning 
has been shown to be a powerful influence on their involve- 
ment (Anderson & Minke, 2007), and an educational text 
messaging program that featured the teacher sending the 
texts demonstrated positive effects on student learning 
(Kraft & Rogers, 2015). Future work should examine the 
effect of a text messaging program that is more aligned to 
classroom supports and delivered by classroom teachers or 
school personnel. 

Perhaps the biggest limitation of the present study is the 
lack of tailoring the literacy intervention to meet the needs of 
parents and children. While we personalized messages with 
children’s names and gender, we did not personalize in ways 
that shared specific information about children’s level of 
skill or instructional needs or provide literacy activities that 
were differentiated to match children’s needs (Doss et al., 
2018; Kraft & Rogers, 2015). Future programs may also be 
tailored to suit parents’ expressed needs as text messaging 
programs in the health field report positive effects of tailor- 
ing based on participant characteristics and situational fac- 
tors (e.g., readiness for change, capacity; Lustria et al., 2013; 
Mistry, Sweet, Rhodes, & Latimer-Cheung, 2015; Noar, 
Benac, & Harris, 2007; Yan et al., 2015). 

In conclusion, this study provides a cautionary note that 
one size seldom fits all. Parents and children seemed to 
respond differentially to the two conditions based on chil- 
dren’s initial skill levels. This study also underscores the 
difficulty of increasing children’s learning through this par- 
ticular low-cost, scalable mechanism of text messages 
designed to promote positive parent-child interactions. 
Recent research demonstrates the viability of an alternate 
mechanism, namely, paying parents of preschoolers a mod- 
est sum for implementing activities ($0.50 per book reading 
session; Justice, Chen, Tambyraja, & Logan, 2018). It is 
clear that more work is needed to identify optimal 
approaches, and it is likely that the best solutions will 
employ a combination of approaches to support the diverse 
needs of families. 
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